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Abstract 

In this work we propose a fully-discrete Semi-Lagrangian scheme for a first order 
mean field game system. We prove that the resulting discretization admits at least 
one solution and, in the scalar case, we prove a convergence result for the scheme. 
Numerical simulations and examples are also discussed. 
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1 Introduction 

Initiated by the seminal work of Aumann [7J, models to study equilibria in games with a 
large number of players have become a important research line in the fields of Economics 
and Applied Mathematics. In this direction, Mean Field Games (MFG) models were 
recently introduced by J-M. Lasry and P.-L. Lions in [20} I2T1 [22] in the form of a new 
system of Partial Differential Equations (PDEs). Under some assumptions, the solution 
of this system captures the main properties of Nash equilibria for differential games with 
a very large number of identical "small" players. For a survey of MFG theory and its 
applications, we refer the reader to p21 [18] and the lectures of P-L. Lions at the College 
de Dance [24]. The evolutive PDE system introduced in [21] . with variables (v,m), is of 
the form: 

-d t v(x,t) ~a 2 Av(x, t) + H{x, Dv(x,t)) = F(x,m(t)), inR d x(0,T), 
d t m(x,t) - <r 2 Am(x,t) - div (d p H (x, Dv(x,t))m(x,t)) =0, in R d x (0, T), (1.1) 
v(x, T) = G{x, m(T)) for x £ R d , m(0) = m £ Pi, 
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where a E R, V\ denotes the space of probability measures on R d and F : R d x V\ -> R, 
G : R d x T 3 ! -> R and H : R d x R d -> R are given functions. The Hamiltonian H 
is supposed to be convex with respect to the second variable p. An important feature 
of the above system is its forward-backward structure: We have a backward Hamilton- 
Jacobi-Bellman (HJB) equation, i.e. with a terminal condition, coupled with a forward 
Fokker-Planck equation with initial datum mo- 

Under rather general assumptions, it can be proved that if a 7^ then (jl.ip admits 
regular solutions (see [221 Theorem 2.6]). Based on this fact, finite differences schemes have 
been thoroughly analyzed in the papers [H [H [2]. When H(x,p) is quadratic with respect 
to p, specific methods have been proposed in [TTl [19] . 

In this work, we are interested in the numerical analysis of the first order case (a = 0) 
with quadratic Hamiltonian H(x,p) = \\p\ 2 - In this case, system (jl.ip takes the form 

-d t v(x,t) + \\Dv{x,t)\ 2 = F(x,m(t)), in R d x (0, T), 
t)-div(Dv(x,t)m(x,t)) = 0, inK d x(0,T), (1.2) 
v(x,T) =G(x,m(T)) for x G R d , m(0) = m G Vi- 

The second equation (i.e. the Fokker-Planck equation with a = 0) is called the continuity 
equation and describes the transport of the initial measure mo by the flow induced by 
—Dv(-, ■). When F and G are non-local and regularizing operators (see [52]), the existence 
of a solution (v,m) of (jl.2p can be proved by a fixed point argument (see |12[ I24|). How- 
ever, the numerical approximation of (v,m) is very challenging since, besides the forward- 
backward structure of (jl.2p . we can expect only Lipchitz regularity for v and L°° regularity 
for m (see e.g. [T2]). 

Although several numerical methods have been analyzed for each one of the equations in 
(11. 2p (see e.g. the monographs [El [29j [25] and the references therein for the HJB equation 
and [26] [30] for the continuity equation), when the coupling between both equations is 
present, the authors are aware only of references [16] . for the scalar case d = 1, and [3], 
for the multidimensional case. However, in both references the structure of the system is 
forward-forward, i.e. both equations have initial conditions. This fact changes completely 
the theoretical and numerical analysis of the problem. As a matter of fact, for example in 
[3] , the key property for convergence result of the proposed numerical scheme is a one side 
Lipschitz condition for Dv(-, ■) of the form: 

3C > such that Vt G [0,T], (Dv(x, t) - Dv(y, t), x - y) > -C\x - y\ 2 . (1.3) 

By the results in [27], condition (jl.3p assures the stability of the so-called Fillipov charac- 
teristics and of the associated measure solutions of the continuity equation, which are the 
key to obtain their convergence result. Unfortunately, in our case (|1.3p corresponds to the 
semiconvexity of v, which does not holds for an arbitrary time horizon T (see [11]). 

Our line of research follows the ideas in |10j . where a semi-discrete in time Semi- 
Lagrangian scheme is proposed to approximate (jl.2p and a convergence result is obtained. 
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However, since the space variable is not discretized, the resulting scheme cannot be simu- 
lated. In this paper we propose a fully-discrete Semi-Lagrangian scheme for (jl.2p and we 
study its main properties. We prove that the fully-discrete problem admits at least one 
solution and, for the case d = 1, we are able to prove the convergence of the scheme to 
a solution (y,m) of (jl.2p . when the discretization parameters tend to zero in a suitable 
manner. The key point of the proof is a weak semiconvavity property for the discretized 
solutions. Let us point out that our approximation scheme is presented in a general dimen- 
sion d and several properties are proved in this generality. However, since in general (|1.3p 
does not hold, uniform estimates in the L°° norm for the solutions of the scheme seems to 
be unavoidable in order to prove the convergence (see [12] for similar arguments regarding 
the vanishing viscosity approximation of (|1.2j) ). Since we are able to prove these bounds 
only for d = 1, our convergence result for the fully-discrete scheme is valid only in this 
case. 

The paper is organized as follows: In Section[2]we state our main assumptions, we collect 
some useful properties about semiconcave functions and we recall the main existence and 
uniqueness results for f)1.2|) . In Section [3] we revisit the semi-discrete in time approximation 
of jlOJ and we improve some results, for example we prove uniform L°° bounds for the 
solutions of the semi-discrete scheme, which improves slightly the convergence result of 
|10j . Section [4] is devoted to the fully-discrete scheme. We establish the main properties of 
the scheme and we prove our main results: The fully-discrete scheme admits at least one 
solution and, if d = 1 and the discretization parameters tend to zero in a suitable manner, 
every limit point of the solutions of the scheme is a solution of (ll.2p . Finally, in Section [5] 
we display some numerical simulations in the case of one space dimension. 



2 Preliminaries 

2.1 Basic assumptions and existence and uniqueness results for ( 11. 2ft 

We denote by V\ the set of the probability measures m such that J* Kd \x\dm{x) < oo. The 
set V\ is be endowed with the Kantorovich-Rubinstein distance 

di(/i,z/) = sup|y <f){x)d[n - v\{x) ; : R d ^ R is 1-Lipschitz | . (2.1) 

Given a measure fi € V\ we denote by supp (fi) its support. In what follows, in order 
to simplify the notation, the operator D (resp. D 2 ) will denote the derivative (resp. the 
second derivative) with respect to the space variable x G M. d . We suppose that the functions 
F, G : R d x T>i -> R and the measure mo, which are the data of (jl.2p . satisfy the following 
assumptions: 

(HI) F and G are continuous over R rf x V\. 
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(H2) There exists a constant cq > such that for any m G V\ 



\\F(. : m)\\ C 2 + \\G(;m)\\ C 2<c 



where \\f(-)\\c* := su P:ceRd {|/(x)| + |D/(x)| + \D*f(x)\}. 



(H3) The initial condition mo G T^i is absolutely continuous with respect to the Lebesgue 
measure, with density still denoted as mo, and satisfies supp (mo) C B(0, c\) and ||mo||oo < 
ci, for some c\ > . 

As a general rule in this paper, given an absolutely continuous measure (w.r.t the 
Lebesgue measure in M. d ) m G V\, its density will still be denoted by m. Let us recall the 
definition of a solution (v,m) of (jl.2p (see [2D USD- 



Definition 2.1 The pair (v,m) E W^ c °°(IR d x [0,2]) x L 1 ^ x (0,T)) is a solution of 
(jl.2p i/ t/ie /irs£ equation is satisfied in the viscosity sense, while the second one is satisfied 



Remark 2.1 Classical arguments (see e.g. f5j/) imply that (|2.2p is equivalent to 



for all t e [0,T] and <j> G C c °°(M d ). 

The following existence result is proved in \14\ [T2] . 

Theorem 2.1 Under (H1)-(H3) i/iere exists at least a solution (v,m) of (|1.2p . 

A uniqueness result can be obtained assuming 
(H4) The following monotonicity conditions hold true 



We have (see [Ml 02]): 

Theorem 2.2 Under (H1)-(H4) system (jl.2p admits a unique solution (v,m). 





(2.3) 



/ K „ [-F(x,mi) 
J Rd [G(x,mi) 



F(x, 1712)] d[mi — m.2](x) > for all mi,m2 G Pi 
G(x, m2)] d[mi — rri2\{x) > for all mi, m,2 G V\. 



(2.4) 
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2.2 Standard semiconcavity results 

In the proof of Theorem 12. 11 as well as in the the proof of our main results, the concept of 
semiconcavity plays a crucial role. For a complete account of the theory and its applications 
to the solution of HJB equations, we refer the reader to the book [11] , 

Definition 2.2 We say that w : R rf — > R is semiconcave with constant C conc > if for 
every x\,x 2 6 R d , A € (0, 1) we have 

iw(Aa?i + (1 - X)x 2 ) > Xw( Xl ) + (1 - A)iu(x 2 ) - A(l - A)^p|:ri - x 2 \ 2 . (2.5) 
A function w is said to be semiconvex if —w is semiconcave. 

Recall that for w : R d ->■ R the super-differential D + w(x) at x E R d is defined as 

D+ W {x) := limsup = ^ = y = " } < j . (2.6) 

I it-* \y-x\ J 

We collect in the following Lemmas some useful properties of semiconcave functions (see 

Lemma 2.1 For a function w : M. d — > R, the following assertions are equivalent: 

(i) The function w is semiconcave, with constant C conc . 

(ii) For all x,y S R rf , we have 

w(x + y) + w(x - y) - 2w(x) < C conc \y\ 2 . 

(iii) For all x, y S R d and p € D + i«(x), g G D + w(y) 

(q -p,y - x) < C conc \x - y\ 2 . (2.7) 

(iv) Setting Id for the identity matrix, we have that D 2 w < C CO ncId in the sense of distri- 
butions. 



Lemma 2.2 Let w : R d — > R be semiconcave. Then: 

(i) w is locally Lipschitz. 

(ii) If w n is a sequence of semiconcave functions (with the same semiconcavity constant) 
converging point-wisely to w, then the convergence is locally uniform and Dw n {-) — > Dw(-) 
a.e. in R d . 
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2.3 Representation formulas for the solutions of the HJB and the conti- 
nuity equations 



Let fi G C([0, T];Vi) be given and let us denote by v\p] for the unique viscosity solution of 

-d t v(x,t) + \\Dv{x,t)\ 2 = F(x,Li(t)), in R d x (0,T), | 
v(x,T) = G(x,fi(T)) inM d . J 



(2. 



Under assumptions (H1)-(H2), standard results (see e.g. [8]) yield that for each 
(x,t) G M rf x [0, T], the following representation formula for v[fj](x,t) holds true 



v[fj](x,t) = in{ aeL 2 ([ttT]m J [i|a(s)| 2 + F(X x ^[a}(s),u(s))] ds 

+G(X x ' t [a](T),u(T)), 
where X x ' t [a}(s) := x — /* a(r)dr for all s e [t, T]. 



We set ^4 x '*[/i] for the set of optimal controls a of (CP) x '*[/i], i.e. for the set of solutions of 
(CV)*' [//]. Classical arguments imply that for all (x,t) the set ^4 x '*[/i] is non empty. 

We now collect some important well known properties of problem (CP) X, *[//] (see e.g. 

ffDnzi). 

Proposition 2.1 Under (H1)-(H2), The value function v[fj] satisfies the following prop- 
erties: 

(i) We have that (x,t) — > v[/j,](x,t) is Lipchitz, with a Lipschitz constant independent of /a. 

(ii) For all t G [0, T] the function v[fi](-,t) G R is semiconcave, uniformly with respect to 

(hi) There exists a constant ci > (independent of (//, x,t)) such that 

IMlL°°([t,T] ; Rd) < c 2 for all a G A^lfj]. 

(iv) For all (x,t) and a G ^. x,i [/i], we have that 

a(t) G D + v[Li](x,t). (2.9) 

(v) For all t G [0,T] the function v[/j](-,t) is differentiable at x iff there exists a G .A^'*^] 
such that A x,t [ij] = {a}. In this case, we have that 

Dv[fi)(x,t) = a{t). (2.10) 

(vi) For every s G (t,T] and a G A x,t \fj\, we have that v[fj](-,-) is differentiable at 
(X^[a](s),s). 
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Now, we define a measurable selection of optimal flows, i.e. of optimal trajectories for 
the family of problems {(CV) x,t [fi] ; (x,t) G M d x [0, T]}. Classical arguments (see [121 E]) 
show that the multivalued map (x,t) — > A x,t [fj], admits a measurable selection a x,t [^\{-). 
Given (x,t) the flow Q[fi](x,t, •) is defined as 

$[/i](x,t,s) := x ~ J a x >%]{r)dr for all s G [t, T] . (2.11) 

By Proposition I2.1( v)-(vi). omitting the dependence on \i for notational convenience, 
t, ■) satisfies 

§- s <f>{x,t,s) = -Dv[fi}(<S>{x,t,s),s) fara€(t,T), 
&(x,t,t) = X. 

For all t G [0, T], let us define m[/x](t) as the initial measure transported by the flow 
More precisely, 

mM(<):=*M(-,0,t)|tmo, (2.13) 

i.e. 

m[/i](i)(A) = m ($[/z] _1 (-,0,t)(A)) for all A G B(R d ), 
or equivalently, for all bounded and continuous <p : R d — >• R, 

/ <j)(x)d[m[fi](t)](x)= [ <j)($[v}(x,0,t))dm (x). 

Since $>[[i](x,-,-) satisfies the semigroup property, omitting the dependence on \i for sim- 
plicity, 

$(x,s,t) = &(&(x,s,r),r,t) for all r G [s,t], 

we easily check that 

m\ji](t) :=*(-, r,t)|J[$(-,0,r)|tmo] = *(-,r,t)Jt[m|>i](r)] for all r G [s, t]. (2.14) 
The fundamental result is the following 

Proposition 2.2 There exists a constant C3 > (independent of (fi,x,y,r,t)), such that 

\$>(x,r,t) — $>(y,r,t)\ > cs\x — y\ for all < r < t, and x,y GM. d . 

The key in the proof of the above Proposition (see e.g. |12l Lemma 4.13]) is the semicon- 
cavity of v[(i](-,t), which is uniform w.r.t jjL, and GronwalFs Lemma. As a consequence we 
have that (see e.g. |12|. Theorem 4.18 and Lemma 4.14]). 
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(2.15) 



Theorem 2.3 We have that m\p](-) is the unique solution (in the distributional sense) of 

dtm(x, t) — div[Dv[fi](x, t)m(x, i)) = 0, in R d x (0,T), 

m(x, 0) = mo(x) inM. d . 

Moreover, there exists a constant C4 > 0, independent of fi, such that m[/j] satisfies the 
following properties: 

(i) For allt G [0, T], the measure m[fj](t) is absolutely continuous (with density still denoted 
by m[fj](t)), has a support in B(0, C4) and (i) Hoo < C4. 

(ii) For all t,t' G [0, T], we /iaue that 

di(/i(t),/i(0) < c 4 |t-t'|. 

Remark 2.2 7n i/ie proof of the above result (see ]12$) Proposition \ 2. 21 is crucial in order to 
show that the transported measure m\p](-) is absolutely continuous, as ttiq, and its density 
remains uniformly bounded in L c 



Theorem O (i)-(ii) implies that m\p](-) G C([0,T];Vi). We thus see that JO]) is 
equivalent to find m G C([0, T]; Vi), such that 

m(t) = $[m](-,0,t)ttm for all t G [0,T]. (MFG) 

3 A revisit to the semi-discrete in time approximation 



In this section we review the semi-discrete in time approximation studied in [TO] and we 
improve some results. 

3.1 Semi-discretization of the HJB equation 

Given h > and N G N such that Nh = T, we set tj~ := kh for k = 0, . . . , N. Let us define 
the following spaces: 

JCn '■= = (^e)eLo '■ such that fi£ G V\ for all I = 0, ... , A?"} , 
A k := I a = (a*)^ 1 : such that G M d } for fc = 0, . . . , JV — 1. 
For n G /Cjv and fc = 1, ... , JV, we consider the following semi-discrete approximation of 

(cvf'M 



{JV-l 
V [±\a e \ 2 + F(X*' k la} : u e )]h + G(X x /la],u N ) 

where X*l -Ja] := X^' fc [a] — hat for I = k . . . , N — 1, 
X^ fe [o;] := a; 



(CP)*-*^]. 
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Note that no discretization is performed in the space variable. As for the continuous 
time problem, we have that (CV)^ k [fj] admits at least a solution for all (x,k). We set by 

Ak[fj](x) C Ak for the set of optimal solutions of (CP)?' [/x], i.e. the set of discrete optimal 
controls. By the discrete dynamic programming principle (see e.g. [8]), Vk[fj](-) can be 
recursively calculated as 



(3-1) 



v k [fj]{x) = inf {v k+1 [u](x - ha) + \h\a\ 2 } + hF(x,fj, k ), k = 0,...,N-l, ) 
vn\m\( x ) = G{x,u N ), ) 
which is a "semi-discrete in time version" of (j2.8|) . Let us set, 

v h M {x, t) := v [t/h] [fi] (x) for all t G [0, T] . 

for the classical "extension" of Vk[fj](-) to a function defined on R d x [0,T]. Now, we provide 
the "discrete" analogous results to those of Proposition 12.11 

Proposition 3.1 For all h > 0, we have: 

(i) For any t G [0, T], the function %[//](•, t) is Lipschitz continuous, with a Lipschitz 
constant independent of \x. 

(ii) For all t G [0, T] the function Vh[fj](-,t) is semiconcave, uniformly in (/i, /i,i). 

(iii) There exists a constant c$ > (independent of (fj,,h,x,k)) such that 

max \aA < C5 for all a G .AjJulfo). 

^=fc,...,A r -l 

(iv) For all x G k = 0, . . . , N — 1 and a G ^4/t[/i](x), we /iai>e 

a* + /iDF fxf' k [a], m) G £> + ^[/i] fx? • k [a], t t ) for £ = k, . . . , N - 1. 



(v) VFe have that Vh\fl](-,t) is differentiate at x iff for k = [t/h] there exists a G Ak such 
that Ak\p](x) = {a}. In that case, the following holds: 

Dv h [fj](x,t) = a k + hDF(x,Hk)- 

(vi) Given (x,t) and a G Ak\p](x), with k = [t/h], we have that for all s G [ifc+i,T], the 
function Vh[fj](-,s) is differentiate at Xf' [a], with £ = [s/h]. 

Proof. We only prove (iv) since the other statements are proved in |lUj . For notational 
convenience, we omit the [i argument and we prove the result for £ = k, since for £ = k + 
1, . . . , N the assertion follows from (v)-(vi). Let x, y G M. d and a > 0. Since a G Ak[p](x), 
we have 



JV-l 

c + ay)< £ [i|a,| 2 + F(^ +<T ^[a],/i,)]/ l + G(x^ fc [a], m ), 

l=k 
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with equality for a = 0. Therefore, 

N-l 

v k (x + ay)-v k (x) < h £ [f (xf +av > k [a], fi t ) - F (xf[a), m)] 

i=k v 3 - 2 ) 
+G (x x N + ^ k [a]^ N ) - G (Xf[a] >m ) . 

On the other hand, the optimality condition for a yields 

JV-i 

a k = h DF (xf[a\,^ + DG (x^a],^ . 

l=k+l 

Combining with (|3.2p and taking the limit as a — > 0, gives 

v k {x + ay) - v k {x) ,> n z7V \ 

hm sup (a k + hDF(x, n k ),y) < 0, 

which, by [111 Proposition 3.15 and Theorem 3.2.1], implies the result. ■ 
Given (x,k) and a G A k [fj](x) we set 

a k [/j]{x) := a k . (3.3) 

Proposition 13. 1 f iv) implies that 

a k [(j](x) G D+v h [n](x,t k ) - hDF(x,u k ). (3.4) 

A straightforward computation shows that a k [fi](x) solves, for each (x,k), the problem 
defined in (|3,1|) . Moreover, by Proposition I3.1( v)-(vi). the following relation holds true 

a e = a £ [fj] (x*' k [a]^J for alU = k, . . . , N - 1. (3.5) 
3.2 Semi-discretization of the continuity equation 

Let a x,fe [/x] G A k be a measurable selection of the multifunction (x,k) — > A k [/j](x). Given 
this measurable selection, we set a k [fi](x) = a^ k [fi], as in (I3.3p . By (I3.4p - (13. 5j) . there 
exists a measurable function (x, A;) — > p k [fj](x) G M d such that p k [fi](x) G D + Ufc[/i](x) and 
for all time iterations £ = k, . . . , N we have 

V' fc Ml) (*?V'*M]) - (AfV' fc MU/) • (3-6) 

Moreover, Proposition 13 . 1 ( v)- ( vi) implies that for £ = k + 1, . . . , N 

pM (Af'K'V]) = Dv e [fj] (X%' k [a x fy}]) for all xGR d (3.7) 
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and 

p k \jj] ( x ) = Dv k \fi\ (x) for a.a. x e R d . (3.8) 

Given (x, kx), the discrete flow 3?^ . \p] (x) £ ^( N ~ k ) xd is defined as 

fe 2 -i 

^fei,fe 2 M( a; ) ■= x - °^ ,kl [fA for a U k 2 > h. (3.9) 

i=ki 

Equivalently, by (|3.6|) . for all ki < k 2 < k%, 

= * hih MW - fcE&%M (^' fel K fcl M]^ 

In particular, for all fci < &2> 

$ fcli fc 2+ i[/i](x) = $ felifc2 [//](a;) - ha k2 [/j] ($ fel)fc J//](x)) . (3.11) 



(3.10) 



The following result, analogous to Proposition I2.2[ is an important improvement of |1CH 
Lemma 3.6]. 

Proposition 3.2 There exists a constant c§ > (independent of f/, and small enough h) 
such that for all k = 1, N and x, y € M. d we have 

\§oM(x) - $o,fc[A*](y)l > cek - y|. (3.12) 
Thus, ^cfc [m] (*) * s invertible in <I>o,fcM(l^ rf ) anc ^ ^ e inverse To ^ s 1/ 1 CQ-Lipschitz. 

Proof. For notational convenience, let us set = <3?o,fcM( x ) and = ^ofcMG/)- 
Expression (|3.11|) implies that 

|$ fc+ i - ^ fc+ i| 2 > |$ fc - ^ fc | 2 - 2/i KM(^fc) - a*M(*fc)] • ( $ fe " **)■ ( 3 - 13 ) 
By (|3.6p we have (omitting the dependence on //) 

M®k) - a fe (* fc ) = Pfe(^fe) - Pk(*k) - h [DF($ k ) - DF(* k )] . 
By the semiconcavity of [//](•) and the semiconvexity of F(-, fJ,(ti)), Lemma l2.1f iii) gives 

- • ($* - * fc ) < c(l + /i) |* fc - * fc | 2 , (3.14) 

for some c > 0. By (I3.13P and (I3.14p . there is d > (independent of /i small enough) such 
that 

|$ fc+ i - * fc+ i| 2 > (1 - /ic') |$ fc - * fe | 2 . 
11 



Therefore, for every k = 1, N, we get 

|* fc+ i - * fc+ i| 2 > (1 - fa/)* \x - y\ 2 > (1 - fa') 1 ™ 1 \x - y\ 2 . 
and the result follows from the convergence of (1 - fa/)PV ft ] to exp(-cT) ash 10. m 

A natural semi-discretization of the solution m\p] of ()2.15p . whose representation for- 
mula is given by fl2. 13f> , is then obtained as the push- forward of mo under the discrete flow 
$>o t k[fj](-), i.e. for every k = 0, . . . , N we define 

™k[lA ■= $o,k\lA(-)$mo- (3-15) 

By dgHUD we have 

m k [/j] = $e,k M(0 $rne\p] for all £ = 1, . . . , k, (3.16) 

which is the analogous to (|2.14p . for the continuous time case. In particular, for all eft £ 
Cfe(M d ) (space of bounded and continuous functions over M. d ), we have 

/ <f>(x)dm k+1 [fi](x) = / (j)(x-ha k [fj](x))dm k [fj,](x), (3.17) 

which applied with 0=1 gives mfc[^](R d ) = 1 for k = 0, . . . , TV. 

We have the following Lemma, which improves |1CH Lemma 3.7] since we now prove, 
using Proposition 13.21 uniform bounds for the density of m k \p]. 

Lemma 3.1 There exist c-j > (independent of (fj,,h)) such that: 

(i) For all ki,k 2 £ {l,...,iV}, we have that 

di(m kl [fj],m k2 [ij]) < c 7 h\ki - k 2 \ = c 7 \t kl -t k2 \. (3.18) 

(ii) For all k = 1, TV, m k [[i] is absolutely continuous (with density still denoted by m k \p]), 
has a support in B(Q, cj) and ||mfc[/u]||oo < cj. 

Proof. By Proposition I3.1f iii) we have 

|^o,itiMW - $o,fc 2 M( x )l < c 5 h\h - k 2 \ = c 5 \t kl - t k2 \. (3.19) 
By definition of m k [//](•); we have that for any 1-Lipschitz function cj) : M. d — > M 
J M d (j){x) d[m kl [n] - m k2 [/j]} (x) < f Rd - <S> , k2 [n}(x)\dm (x) 

< c 5 /i|fci - k 2 \ = c 5 \t kl - t k2 \. 

On the other hand, since by (HI) we have supp (mo) C -6(0, ci), Proposition I3.1f iii) 
implies that supp (m k [fj]) is contained in B(0,ci + 2c^T). Moreover, for any Borel set A 
and k = 1, ...,iV, Proposition 13.21 and the fact that ||mo||oo < c i imply 

mjfcMCA) = m (T ,fcM(A)) < ||mo||oo|T 0) fc(A)| < 
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where \A\ denotes the Lebesgue measure of the set A. Thus, is absolutely continuous 

and its density, still denoted by m.fc[/i], satisfies ||mfc[//] ||oo < |jk The result follows by taking 
c 7 = max{c 5 ,ci + 2c 5 T, ci/c 6 }. ■ 

We now define 

m h [lj](t) := t -^~ L j i — -rrikl/j] + ^ m k+i[lA if * G [t k ,t k+1 ]. (3.20) 
The following result is a clear consequence of Lemma 13.11 and (|3.20p . 

Proposition 3.3 There exists constants eg > (independent of /i and small enough h) 
such that: 

(i) For all t\,t2 G [0, T], we have that 

di(m ft [ju](ii),m/ l [//](t2)) < Qs |*i — *a I ■ (3.21) 

(ii) For allt G [0, T], mh[fj](t) is absolutely continuous (with density denoted by [//](• , t) ) , 
has a support in S(0,c§) and ||m^[/i](-, t)||oo < eg. 

3.3 The semi-discrete scheme for the first order MFG problem ( 11 .2j) 

For a given TV > 0, consider the following semi- discretization of (MFG): 

Find m G /Cat such that = $o,fc[ m ](")tt m o f° r all A; = 0, . . . , N, (MFG) h . 
The following result is proved in [10j . 

Theorem 3.1 Under (H1)-(H3) we have that (MFG) h admits at least one solution G 
/Cat. Moreover, if (H4) holds, the solution is unique. 

Given any solution rrih of (MFG)^, using (I3.20p we define an element, still denoted by 
m h , in C{%T]-Vi). 

Theorem 3.2 Under (H1)-(H3) every limit point of mh in C([0,T];Vi), as h 10, solves 
(MFG). In particular, i/(H4) holds we have that mh — > m (the unique solution of (MFG)) 
in C(%T];Vi) and in L°° (R d x [0,T])-weak-*. 

Proof. Proposition 13.31 and Ascoli Theorem imply that has at least one limit point 
m in C([0,T];7 3 i) as h X 0. The fact that m solves (MFG) is proved in [El Theorem 4.3] 
using optimal control techniques. Finally, by Proposition I3.3f ii) we have that m/, — > fh in 
L°° (M d x [0,T])-weak-*. The result follows. ■ 
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4 The fully-discrete scheme 

Given h, p > 0, we consider a d dimensional lattice Q p := {x^ = ip, i G Z, d } and a time- 
space grid Q p> h := Q p x {ifclfcLc where = kh (k = 0, . . . , iV) and = Nh = T. We set 
B(Q p ) and B(Q p f l ) for the space of bounded functions defined on Q p and G p ,h, respectively. 
Given / G B(Q p ) and <? G B(G Pt h) we will use the notation 

fi'.= f(xi), g ijk := g(xi,t k ) for alH G Z d and k = 0, . . . ,N. 

Let us consider the Pi basis {/% ; i G where the function : R rf — >• R is defined 
by fti(x) := [l — — ] , := max{[l — ii£z_£ilil ) o} . Denoting by ei,...,e<i the canonical 
base of M. d , it is easy to verify that (3i(x) is continuous with compact support contained 
in Q(xi) := [x» - pei,Xi + pei] x ••• x [xi - ped,Xi + pe^], < fa < 1, /3j(xj) = <5jj 
(the Kronecker symbol) and X^ez d /%(- c ) = 1- Let us cons ider the interpolation operator 
/[•] : -> C7 6 (R d ), as 

/[/](•) :=£/*8i(0- (4-1) 

We recall a standard estimate for / (see e.g. [HIES])- Given <p G C&(R d ), let us define 
G by := <f>{xi) for all i G 1 d . We have that 

sup \I[$\{x) - <f>(x)\ = 0(p 7 ), (4.2) 

where 7 = 1 if is Lipschitz and 7 = 2 if G C 2 (R d ). 

4.1 The fully-discrete scheme for the HJB equation 

For a given p, G C([0, T], Vi), we define recursively i> G B{Q p i l ) using the following Semi- 
Lagrangian scheme for (|2.8p : 

Vi,k = S Pj h[p](v. jk +i,i, k) k = 0, . . . ,N - 1 and v i:N = G(xi, p(t N )), (4.3) 

where : B(<7 P ) x Z d x {0, . . . , N - 1} -> R is defined as 

5 M M(/,i,fc):= inf [/[/](xi-/ia) + i%| 2 ] + hF( Xi , »(t k )). (4.4) 

The following properties of S^/J/i] are a straightforward consequence of the definition and 
assumptions (HI) and (H2). 

Lemma 4.1 The following assertions hold true: 

(i) [The scheme is well defined] There exists at least one a G M. d that minimizes the r.h.s. 
of (I4.4p . Moreover, there exists eg > such that sup igZ d k=0 N \vi >k \ < eg. 
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(ii) [Monotonicity] For all v,w E B(Q p ) with v < w, we have that 

S p>h [p](v,i,k)<S Pjh \ji](w,i,k) Vi£Z d , k = 0,...,N. (4.5) 

(iii) For every K E R and u; E B(Q p ) we have 

S p ,h[p](w + K,i,n) = s P AlA( w ,h n ) + K - ( 4 - 6 ) 

(iv) [Consistency] Lei (p n ,h n ) — > (as n ^ oo) and consider a sequence of grid points 
(xi n ,tk n ) — > (x,t) and a sequence \i n E C($,T\\V\) suc/i that p, n — > p. Then, for every 
<f> E C 1 (R d x [0, T)) , we have 

limn^oo ^- [<j>{x in ,t kn ) - S Pnihn [u n ]((j> krl+1 ,i n , fc„)] = -d t <f){x,t) + \\D(p(x,t)(x,t)\ 2 

-F(x,p(t)). [ ■'> 

where 4> k = {<P(xi,t k )} ieZd . 
We define 

v Pjh [fj](x,t) :=I[v, rti](x) for all (x, t) E M d x [0, T], (4.8) 

where we recall that i^fc is defined by (|4.3p . 

The following notion of weak semiconcavity (see e.g. |23j). will be very useful. 

Definition 4.1 Given C, p > 0, we say f/iai / : R — > R is (C, p)-weakly semiconcave if 
for all x,y £ M. d and A E [0, 1] we /iai>e 

A/Or) + (1 - A)/(y) < f(\x + (1 - A)y) + ^A(l - A) (\x - y\ 2 + p 2 ) . (4.9) 

For the sake of completeness, we recall the following elementary properties of weak semi- 
concave whose proofs are easy adaptations of the semiconcave case. 

Lemma 4.2 For a continuously differentiate function f : M. d — > R the following assertions 
are equivalent: 

(i) The function f is (C, p) -weakly semiconcave. 

(ii) For every x,y E M. d 

f(x + y)- 2f(x) + f(x -y)< C(\y\ 2 + p 2 ). (4.10) 

(iii) For every x, y E M. d 

f(y) - f(x) - (Df(x),y - x) < - (\y - x\ 2 + p 2 ) . (4.11) 

In particular, if f is (C, p) -weakly semiconcave then 

(Df(y)-Df(x),y-x)<C{\y-x\ 2 + p 2 ) Vx,y£R d . (4.12) 
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The following result yields the weak semiconcavity of v Pt h[p\- 
Lemma 4.3 For every t E [0, T], the following assertions hold true: 

(i) [Lipschitz property] The function v p ^h[p](-,t) is Lipschitz with constant independent of 
(p,h,n,t). 

(ii) [Weak semiconcavity] The function v p ^[p](-,t) is (C,p)-weakly semiconcave, with C 
independent of (p, h, p, t). 

Proof. By (H2) we have that \\DG(; At(T'))|| 00 < c and so I[G](-,p(T)) is c -Lipschitz. 
Thus, by the (|4.3p and (|4.8p . we get that v Pt h\p](-,tN-i) is Lipschitz with constant hc^ + c^. 
Iterating the argument, using (H2) for F, we get that v Pt h\p](-,t) is co(l + T) Lipschitz 
for all t G [0, T]. The proof of the second assertion is provided e.g. in [3j Lemma 4.1]. ■ 

2 

Theorem 4.1 Let (p n , h n ) — > (as n ^ oo) be such that — > 0. Then, for every sequence 
p n G C([0,T];'Pi) suc/i i/iai p n ^ p in C([0,T];Vi), we have that v Pnt h n [p n ] v[p] 
uniformly over compact sets. 

Proof. Using assumption (HI), the proof of this results is a straightforward variation of 
the proof in |13j . which is a revised proof of the result given in [9]. However, for the sake 
of completeness we provide the details. For (y,s) G M. d x [0,T], set 

v*(y,s):= limsup v Pn)hn [p n ](y' , a'), v*(y, s) := lirnint v PnAn [p n ](y' , s'). 

(y',s')-^(y,s) (y ,s')->{y,s) 



Let us prove that v* is a viscosity subsolution of 

-d t v(x,t) + h\Dv(x, t)\ 2 = F(x,p(t)) for (x,t) el^x (0,T), 

( 4 - 13 ) 

u(x,r) = G(x,p(T)) for a; G 

Let (y, s) E R d x (0, T) and cf) G C7 1 (M d x (0, T)) be such that s) = 4>(y, s) and v* - <j> 
has a global strict maximum at (y,s). Since «*(•,■) is upper semicontinuous, a standard 
argument in the theory of viscosity solutions implies that, up to some subsequence, there 
exists (y n , s n ) — > (y, s), such that 

(vpn-hA^n] - <p)(y n ,s n ) = max K>„,fc„[/v] - <f>)(y, s) 

(y,s)SR d x(0,T) 

and (v Pnt h n [Pn] ~ <t>){Vn,s n ) -> (v* - cj>)(y, s) = 0. 
Thus, for any (y, s) G M. d x [0, T] we have that 

U Pn,hn[^n](2/,s) < 4>(Vi S ) +€n, with £n == {Vp n ,h n [Pn] ~ 4>){Vn, S n ) -> 0. (4.14) 
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Let k := N — > {0, ... ,N — 1} be such that s n G [ifc(n)i *fc(n)+i)- Evidently, we have that 
^fc(n) ~~ > s- By taking y = Xi, i G 7L A \ and s = tfc(n)+i m (|4.14|) . we get that 

%k(n)+i < 00^ *fc(n)+i) + for all i G Z d . (4.15) 
Lemma l4.1( ii)-(iii) implies that 

' S 'p„,/ ln [^n](f.,fe(n)+l ) « ) fc(ra)) < S pnyhn [fi n ]{(j) k{n)+1 ,i, k(n)) + £ n for all i G Z d . 
In particular, using (|4.3p . we get 

"i,fc(n) < S Pn , hn \Pn](^k(n)+l,h K n )) + for all t G 

which yields, by the definition of v Pnthn \p n ](y n ,s n ) in (|3~BJ) . 
Now, recalling the definition of £ n , we get 

<j>(y n ,Sn) < ^2 Pi(yn) S Pn^AVn]{(i)k(n)+l:hK n ))- ( 4 - 16 ) 

We claim now that 4>(y n ,s n ) = (ft(y n ,tk(n)) + O(h^). In fact, either s n = (and the 
claim obviously holds), or s n G (ifc( n )^fc(n)+i)- I* 1 the latter case, since (v Pnt h n — <fi)(y n r) 
has a maximum at s n and v pni f ln is constant in (ijfc( n )j*jfc(n)+l)> then dt4>(y n ,Sn) = and 
the claim follows from a Taylor expansion. Thus, by our claim and (|4.16j) . we have that 

4>{yn,tk(n)) < Pi(yn) S p n ^AVn]{(l)k(n)+l,hK n )) +o{h n ). (4.17) 

Now, inequality (|4.17p . estimate (|4.2p and the fact that p^Jh n — > imply that 

>(xi,t fc ( n )) - 5 Pni ft>„](4( n ) + i,i,fc(n)) 

'i(yn) — r — < o. 

K 

Finally, by the consistency property in Lemma l4.1f iv) we obtain that 

-dt<f>(y, s) + \\D<j){y, s)\ 2 - F(y, < 0, 

which implies that v* is a subsolution of (|4.14p . The supersolution property for v* can 
be proved in a similar manner. Therefore, by a classical comparison argument, v Pn) h n [[i n ] 
converges locally uniformly to v[fj] inR d x (0,T). ■ 



lim \ 
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Note that for all t G [0,T], the function v Pt h[p](-,t) is not, in general, differentiable 
at Xi G Q p . Thus, we cannot use the useful characterizations of weak semiconcavity (see 
Lemma |4.2|) for differentiable functions. Therefore, we will regularize v Pt h[p](',t) with the 
usual convolution technique. Let p G C^°(M. d ) with p > and f Rd p(x)dx = 1. For e > 0, 
we consider the mollifier p £ (x) := (f ) and define 

Vp,h[tA(;t)-=Pe*v Pjh [ t i]{;t) for all t G [0, T]. (4.18) 

Using Lemma l4.3( i) we easily check the estimates 

\\ v p,h[fA(-r)-VpM(;-)\\oo = 7£, 

(4.19) 

\\Dv £ P ,M(;-)\\oo = I 
where 7 > is independent of (e, p, h, p, t). We have: 
Lemma 4.4 For every t G [0, T], the following assertions hold true: 

(i) [Lipschitz property] The function v £ ph [p](-,t) is Lipschitz with constant do independent 
of (p,h,n,t). 

(ii) [Weak semiconcavity] The function v £ ph [p](-,t) is (d\, p) -weakly semiconcave, with d\ 
independent of (p, h, e, p, t). 

Proof. The result follows directly from the definition of v £ f\p\{-, t) and the corresponding 
results for v P: h[p](-,t) in Lemma [4TH1 ■ 

As a consequence we obtain 

2 

Theorem 4.2 Let (p n ,h n ,e n ) — > (as n f 00) be such that — > 0. Then, for every 
sequence p n G C([0,T];Vi) such that p n — > p in C([0,T];Vi), we have that v e p " hn [p n ] — > 
v[p] uniformly over compact sets and Dv e ™ hn [p n ](x,t) — > Dv[p](x,t) at every (x,t) such 
that Dv[p](x,t) exists. 

Proof. The first assertion is a consequence of Theorem [JT] and the uniform estimate (|4.19p . 
Now, Lemma 14.41 and Lemma l4.2( iii) imply that Dv p ™ hn [/i n ](a;, t) is uniformly bounded in 
n and 

v pZ,hn^n](y,t) - v pZ,hJ»n](x,t) - (Dv £ p l hn [p n ](x,t),y- x) < \d x (\y - x\ 2 + p 2 n ) . 
Thus, every limit point p of t Dv p " h [p n ](x,t) satisfies 

v[p](y,t) - v[p](y,t) - (p,y - x) < \di\y - x\ 2 for all x,y€M. d . 

Therefore, if Dv[p](x,t) exists, the semiconcavity of v[p] implies that p = Dv[p](x,t) from 
which the result follows. ■ 
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4.2 The fully-discrete scheme for the continuity equation 

Given fj, £ C([0, T\; V\) and e > let us define 

$i,k,k+M ■= Xi - h&l k \p] for all i £ Z d , k = 0, . . . , N - 1, (4.20) 

where a\ k := a £ h [n]{ x i^k) and & E ph [^] ■ K d x [0, T] — > R d is defined as 

&p,fM(x,t) ■= Dv £ pih [fi](x,t). (4.21) 

Given the family {$f )fefe+1 M ; i £l d , k = 0, . . . , N - 1}, we now consider a fully- 
discrete scheme for ()2. 15j) which turns out to be equivalent to the one proposed [26] . under 
some slight change of notation. Let us define 

S := < z = (zi) i€Z d ; z% € M + and ^ Zj = 1 

The coordinates of m G 5tv+i := = { u i) k= Q '■> u k ^ S} are denoted as m^, with i £ Z d 
and A; = 0, iV. We set 

Ei := [xi ± |pei] x ... x [xi ± ^pej for all i G Z d , 
and define m e [p] S 5/v+i recursively as 

*»f,*+iM - ^ (n^ k+ M) m lM, ionei d , k = o,...,N-i, 

TO ioM := Ie - m o(x)dx, for i e Z d . 
Remark 4.1 Note that, omitting the dependence in jjl, for k = 0, . . . , N — 1 we have that 

Y m U+i = EEft m h = Y m ik Y ^ = Y = '• 

because Y2j£Z d m j o = 1- Therefore, the scheme (|4.22|) zs conservative. 
Let us define m^[/i] G L°°(lR d x [0,T]) as 



if t e [tfe,tfe+i). 
Therefore, for every t G we have 



(4.23) 



■= ( tk+1 h - ) m s Pi M(x,t k ) + (LJ* ) m^^Ka?,^). (4.24) 
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By abuse of notation, we continue to write Tn £ h [p](t) for the probability measure in M. d 
whose density is given by (|4.23|) , Thus, by the very definition, we can identify m £ p h [p](-, •) G 
L°°(R d x [0,T]) with an element m £ p>h [p]{-) G C([0, T];Vi). 

We now study some technical properties of the family {^f & ; i G Z rf , k = 

0, . . . , N — 1}. The next result, which is an easy consequence of the weak semiconcavity of 
v ph [p], is similar to the one proved in Proposition 13. 2[ 

Proposition 4.1 For any i,j £ Z rf and = 0, . . . , N — 1, we have 

I*UjH-iM - ^kfc+iMI 2 > (1 - Wki " x i\ 2 ~ d2hp 2 , (4.25) 
where d.2 > is independent of (p,h,e, p). 

Proof. For the reader's convenience, we omit the p argument. Recalling (|4.20p and (|4.2ip . 
for every k = 0, . . . , N — 1 we have 



\(f> £ — cf> £ I 2 

\^i,k,k+l ^j,k,k+l\ 



. 2 

«i- -i hi 



Dv £ ph (xi,t k ) - Dv £ ph (xj,t k ) 

= \xi - xj\ 2 + h 2 \Dv £ ph {x h t k ) - Dv £ p h (xj,t k )\' 2 + 
-2h{Dv £ ph (xi,t k ) - Dv £ ph (xj,t k ),Xi - Xj), 

which yields to 

\$i,k,k+i - ®lk,k+i\ 2 > \xi-Xj\ 2 - 2h(Dv £ ph (xi,t k ) - Dif pih (xj,t k ),Xi - Xj). 

Therefore, by Lemma l4.4f ii) and (|4.12|) in Lemma 14.21 there exists di > such that (|4.25|) 
holds. ■ 

Now we provide a technical result which, in the case d = 1, allow us to obtain uniform 
L°° bounds for m £ ,[p] (see Proposition I4.2f ii) below). 

Lemma 4.5 Suppose that d = 1. Then, there exists d^ > (independent ofh small enough 
and (p, e, p) ) such that for any % £ Z and k = 0, . . . , N — 1, we have that 

EAfe,w)<l + d3/>. (4.26) 

Proof. For notational simplicity, let us set yj = <& £ k k+l . Note that for any j\,j2 £ Z, 
Proposition 14.11 implies that 

Is/ji ~ 2/j 2 1 2 > (1 - d 2 h ) \ x h ~ x h\ 2 ~ d2hp 2 . 

Thus, if ji / j 2 , we get 

ll/ii " Vh\ 2 > (1 - M 2/i) /A i.e. |j& - %| > V(l " 2d 2 /i)p. (4.27) 
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Since the diameter of supp(/3j) is equal to 2p, the above inequality implies that for h small 
enough (independent of (p, £,//)), the cardinality of 

Zi := {j G Z ; ^ G supp(/3;))} 

is at most 3. If Zi only has one element, then (|4.26p is trivial. If Zi has two elements yj t , 
y j2 with y h < y h , then 



Xi 



%i | 



< 2 



by the triangular inequality. Using (J4.27P we get 



PiiVji) + PiiVja) < 2 - V(l - 2d 2 /i) < 1 + 2d 2 /i, 

from which (14. 27ft follows. Finally, if Zi has three elements yj t , yj 2 and yj 3 , then (supposing 
for example that yj x < yj 2 < X{ < yj 3 ) we have 



PiiVji) + fciVji) 



I _ Xi Vh _|_ ^ 



P_ P 
P P 



< 2 - 2^/(1 - 2d 2 /i) < 4d 2 /i. 



Using that f3i{yj 2 ) < 1 and the above estimate, we obtain (|4.27p with d% := 4d 2 . ■ 

Using the above results, we can establish some important properties for m e h \p], which 
are similar to those found for m/jf/x] in the semi-discrete case (see Proposition 13. 3p . 



Proposition 4.2 Suppose that p = 0{h). Then, there exists a constant > (indepen- 
dent of (p, h, e, /i) J such that: 
(i) For a// ii,i 2 G [0,T], we Ziawe that 



d i(ra* h M(ti),m* h M(t 2 )) <d 4 |ii-i2|- 

(ii) For all t G [0,T], mfj h [p](t) has a support in B(Q, 0I4). 
(hi) If d = 1 then we have 

NmM(->*)I|oo < cfc. 

Proof. Let G C(M q! ) be a 1-Lipschitz function. By (l4~24l) . the function ^ : [0,T] 
defined as 



(4.28) 



<f){x)dm e h [p](t), 



is affine in each interval [t^, tj~+i\, with k = 0, . . . , N — 1. It clearly belongs to W 1,oo ([0, T]) 
and 



■*/'</> 



1 

— max 
h k=0,...,N-l 



(j>(x)d[m £ h [p](t k+1 ) - m e h [fi\(t k )] 
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For every k = 0, . . . , TV — 1 we have, omitting p, from the notation, 



/ 4>(x)d[m pM (t k+1 ) - m Pth (t k )\ = -4 yZ / ^(a;)da 



^ft (&j,h,k+l) m ] 



jet 



jS2 



lGXd P Je 1 P J Ej 



4>(x)dx 



On the other hand, since <f> is 1-Lipschitz, we have that 



~~j ( (p(x)dx - <j)(xi) • 

P JEi 



P- 



(4.29) 



Using (|4.29p . estimate (]4.2|) . Lemma l4T47 i) and the fact that p = 0(h), we get that 

+ 2p, 



\f M d <P(x)d[m pih (t k+1 ) -m p:h (t k )]\ < J2 m l,j 

jeiA 

= E m l,j 
< d h + 2cp = (d + 2££) h < c'h, 



E ft (*5,*,W-i) " 

iGZ d 

</> (*i,fc, fe +i) - 0(asi)| +2 C/ 9, 



for some constants c, c' > independents of (p, h,e, p). Therefore, we obtain that 
H^Vvll < c 'j which proves (i) with to be chosen later. 

In order to prove (ii), it suffices to note that since ||-Dfp /J//]||oo < do we easily check 
that supp (Tn £ p h \p](t)) C B(0,a + 2doT). Now, let us assume d = 1. By the definition of 
m p h [/•*]("> 0) m Q4.23P and assumption (HI), we have 

IIKU^K-^Hoo =max{-m? [ j u]l < ||m |U < 
Now, given k = 0, . . . , N — 1, we have that 



m 



MO, **+i)lloo < max | -rnl k+1 [n] \ = - max \ ^ ft (^ fcjfc+1 M) > . 



Therefore, by Lemma 14.51 we obtain that 

IK,hM(-,*fc+i)lloo < ||m* ih M(-.tik)||ooX]A ^ (i + ^MII^.hMCtfc)!! 



Iterating in the above expression, we obtain that 



l m p,fcM(-»*fc+i)IU < (l + d 3 /j)^|l m o||oo < e d3T ci 



for h small enough. The result follows, by taking <i 4 = max{c',ci + 2d Q T , e d ' iT c\} . 
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4.3 The fully-discrete scheme for the first order MFG problem (ll.2p 

For a given p, h, e > and p G S N+1 we still write p for the element in C([0, T];V\) defined 



as 



/ N 1 

p (x,t) := — 
p a 



tk + l — t ST^ rr , X t — if. 



h 

i<=z d 



if t€ [tk,t k +l]. (4.30) 



Let us consider the following fully- discretization of (MFG): 

Find p G Sjv+i such that pi^ = m £ k [p] V i G Z d and k = 0, . . . , N, (4.31) 

where we recall that m^ fc [/i] is defined in (|4.22p . In order to prove that (|4.3ip admits at 
least a solution, we will need the following stability result. 

Lemma 4.6 Let p n G 5/v+i be s a sequence converging to p G <Sjv+i. Then: 

(i) ^ [//*](•, •) — ^ uniformly over compact sets. 

(ii) mf fc [/i"] -> mf )fe [/x] /or all i e Z d and k = 0, ... , TV. 

Proof. Because of the assumptions on i 7 and G in (HI) we clearly have (i). By definition 
of i>p h [p n ](x, t) and (i), Lebesgue theorem implies that we have pointwise convergence of 

Dv £ ph [p n ] to Dv ph [p] and obvoiusly also of a§' h [p n ](-, •) — >■ ae ,/l [/z](-, •). Assertion (ii) for 
i £ and k = 1 follows hence from the definition (|4.22p of mf 1 [/i n ]. Therefore, by 
recursive argument we get the result for all j £ Z rf and k = 0, . . . , N — 1. ■ 

Theorem 4.3 There exists at least one solution of (|4.3ip . 



Proof. This is a straightforward consequence of Lemma 14.61 Proposition I4.2f ii) and 
Brouwer fixed-point theorem. 

■ 



Given a solution m £ G 5tv+i of (|4.3ip . we set rn £ ,(■, •) for the extension to M d x [0, T] 



defined in (|423j) . 

Now we prove our main result. 



Theorem 4.4 Suppose that d = 1 an<i i/iai (H1)-(H3) /io/d. Consider a sequence of 
positive numbers p n , h n ,e n satisfying that p n = o (h n ), h n = o{e n ) and e n X as n t oo. Let 
{m n } ng pj be a sequence of solutions of (14.3ip /or i/ie corresponding parameters p n ,h n ,e n . 
Then every limit point in C([0,T];'Pi) of m n (there exists at least one) solves (MFG). In 
particular, if (H4) holds we have that m^™ hn — > m (the unique solution of (MFG)) in 
C([0,T};Ti) and in L°° (R d x [0,T])-weak-*. 
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Proof. For notational convenience we will write v n := v £ p n h [m n \. By Proposition I4.2f i) 
and Ascoli theorem we can assume the existence of m G C([0,T];Vi) such that m n (as 
an element of C([0,T];Vi)) converge to rn in C([0, T\; V\)- Moreover, Proposition I4.2l fiii) 
implies that, up to some subsequence, m n (as an element of L°°(IR d x [0,T])) converge 
in L°° (R d x [0,T])-weak-* to some rh. Thus, we necessarily have that m is absolutely 
continuous and its density, still denoted as rh, is equal to rh. In order to complete the 
proof, we now show that rh solves the continuity equation (|2,3p . i.e. for any t G [0,T] and 
6 G C?°(M. d ) 



(f)(x)dm(t)(x) = / 4>(x)dmo(x) 



D(p(x)Dv[m](x , s)dm(s)(x)ds. (4.32) 



Given t £ [0, T], let us set t n :- 



h„. We have 



n-l 



4>{x)dm n (t n ) 



f <A(x)dm (x) + [ <K*)d [m n (t h+1 ) - m n (t k )} . (4.33) 

J IR q J M 



By definitions (14T22D and (14T23"]) . setting fc+1 := Xi-h n Dv n (xi,t k ), for all fe = 0, 
we have 

f R <P{x)dm n {t k+1 ) = Ei& m Zk+i]t; f El 0( x ) dx > 

= E iez i f Ei 0(x)dxE iez ft (*s:* ffc+ i) 

As in (|4.29p we get 

- / <p{x)dx- 4>(xi) < ||-D(/)||ooP- 
PJEi 

Therefore, combining with (|4.34p . we get (recalling (|4.2I) with 7 = 1) 

f R <P(x)dm n (t k+1 ) = Ej-ez^EigzA^jfe+O^O + OCp), 
= E i6 zm? fc /[0](^ fc)fc+1 )+O(p), 



, re— 1 



(4.34) 



(4.35) 



On the other hand, by Lemma I4.3( i). the function v n (-,t) is Lipschitz (with Lipschitz 
constant independent of n). Therefore, by (|4.19p we have the existence of a constant c > 
(independent of n) such that 



\Dv n (x,t) - Dv n (y,t)\ < —\x-y\ 



(4.36) 
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which implies, setting k+l( x ) = x ~ hnDv n (x,t), that 

\<t> (n, k+ i(x)) - <p (n, k+ i(y)) I <c'{i+ \x- y \. 

for some c' > c (which is also independent of n). Therefore, we have 



1 



Since = 0(1), by (f4\35j) . we get 



1 + ^) 



= / R ^fe, fc+ i(^))dm"(t fe ) + 0(p). 



The expression above yields to 

f R <P(x)d[m n (t k+1 )-m n (t k )] = / H 



4> 



x) ) -0(x) dm n (i fc ) + 0(p) 



-fc n / R D<j>{x)Dv n (x, t k )dm n {t k ) 
+0 {hi + Pn ) 



(4.37) 



Since D<p(-) • Dv n (-,t k ) is c"/e n -Lipschitz (with c" large enough), Proposition I4.2f i) gives 
that for all s € [t k ,t k+ i], with k = 0, . . . , n — 1, we have 



Dcj)(x)Dv n (x, t k )d [m n (s) - m n {t k )] 



c" , . c"/i n 
< — |s - t k \ < , 



which implies that, using that Dv n (x,s) = Dv n (x,t k ) for s S [t k ,t k+ i[, 



■k+l 



D<j)(x)Dv n (x, s)d [m n (s) - m n (t k )} ds 



c"h 2 



< 



(4.38) 



Therefore, combining (j4.38p and (|4.37[) . we obtain that 

f R <P(x)d[m n (t k+1 )-m n (t k )} = -JJ+ 1 f R Dcb(x)Dv n (x,s)dm n (s)(x)ds 



Thus, summing from k = to k = n — 1 and using (|4.33D 

^{x)dm n {t n ){x) = J^(x)m n (x,0) - /„*» J* K D(/)(x)Dv n (x, s)m n (x, s)dx ds 



(4.39) 
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By Theorem 14.21 we have that Dv n (x,s) —> Dv[m](x,s) for a. a. (x,s) fix [0,T]. There- 
fore, using that <p 6 C£°(M), the Lebesgue theorem implies that 

I [0ttn] Dcj>(-) • Dv n (-,-) -> I [0 , t] ity(-) • £Mm]( v ) G L X (R x [0,T]) strongly in L\ 

and since m n converge to m in L°° (M x [0, T])-weak-*, we can pass to the limit in (|4.39l) 
to obtain (|4.32p . The result follows. ■ 

5 Numerical Tests 

We show numerical simulations for the case d = 1. Given e, p, h > we set {m £ k ; i G 
Z d , fc = 0, ...,[£] } for the solution of HOT)! and {u? fc ; t G Z d , k = 0, . . . , ] } for the 
associate value functions. We approximate heuristically m| fc and vf k with a fixed-point 
iteration method. We consider as initial guess the element in m £, ° £ Sjy+i given by 



e,0 



f = / m$(x)dx, i G Z, fe = 0, . . . , N. 



Next, for p = 0, 1, 2, . . ., given m £ ' p G 5tv+i we calculate v e,p+l G B{Q p f l ) with the backward 
scheme (|4.3p . taking as p the extension of m e ' p to C([0, T];"Pi) defined in (|4.30p . The 
element m £,p+1 G Sn+i is then computed with the forward scheme (|4.22p . taking 

p(x) = ^~ x2 ' 2 - (5-1) 

In the numerical simulations we approximate (|4.2ip with a discrete convolution using a 
central difference scheme for the gradient. The iteration process is stopped once the quan- 
tities 

E{v £ 'P) := \\v £ ' p+1 - v^Woo, E{m £ ' p ) := ||m e ' p+1 - m £ ' p ||oo, (5.2) 
are below a given threshold r. 

Remark 5.1 The theoretical study of the convergence of the fixed-point iterations is not 
analyzed in the present paper. The analysis of a convergent and efficient method to solve 
(I4.3ip remains as subject of future research. 



By Proposition 14.2( h) . we know that m £ has a compact support, uniformly in (e,p,h). 
Therefore, in order to calculate the iteration rn e i , k +1 we only need the values for i 

such that ip belongs to a compact set K, which is independent of (e,p,h,p). This fact 
allows us to drop the analysis of boundary conditions. 

For the numerical tests we will consider running costs of the form 

^a 2 (t) + F(x, m(t)) = -a 2 (t) + f(x) + V(x, m(t)), 
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where / is C 2 and 



V(x, m(t)) = p a * [pa * m(t)] (x), for some a > to be chosen later. (5.3) 

A straightforward calculation shows that F(x,m(t)) = f{x) + V(x,m(t)) satisfies assump- 
tion (H4). 

5.1 Test 1 

We simulate a game where the agents are adverse to the presence of other agents during 
the game and, at the end, they do not want to live at the boundary of a domain 0. 
In order to model this situation, we take = [—0.2, 1.2], and the running cost 

^a 2 + F(x, m) = ^a 2 + 0.3F(x, m), 

where V given by (|5.3[) with a = 0.3. We choose T = 1 as final time and 

G(x) = -0.5(:r + 0.5) 2 (1.5 - x) 2 , 

as final cost function. We take as initial mass distribution 

v(x) 

WOW = 7 7T7- 

Jn v{x)dx 

where u(x) = I[ 0> i](x)(l — 0.2 cos(7rx)). We choose e = 0.1, as space step p = 1.75 • 10~ 2 
and as time step h = 0.02. 

The function F penalizes high mass density during the game whereas the final condition 
G penalizes the fact that the agents are near the boundary at time T. In Fig(TJ we show 
the mass evolution in the time-space domain Q x [0, T]. It is possible to observe that from 
the initial configuration, the mass distribution moves where the final cost is lower and at 
the same time it does not accumulate completely at the center. 

In Fig. [2] the discrete value function vf k and in Fig. [3] the gradient Dvf k are shown in the 
domain $7 x [0, T\. Fig. |4] shows the behavior of the errors (|5.2p in logarithmic scale on 
the y-axis with respect to number of fixed-point iterations on the x-axis. The fixed point 
iteration method has been stopped when both errors are below r = 10~ 3 . 

5.2 Test 2 

We model now a game where the agents want to live at x = 0.2 but again they are adverse 
to the presence of other agents. We consider a space numerical domain given by £1 = [0, 1] 
and a final time T = 1. The running cost function is modeled as 

^a 2 + F(x, m) = ^a 2 + (x - 0.2) 2 + V(x, m), 
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Figure 1: Mass evolution mf 




Figure 2: Value function v\ k 



Figure 3: Gradient Dvf 



where V(x, m) is denned in (|5.3p with a = 0.05. We do not consider a final cost, i.e. we 
take G = 0. We choose as initial mass distribution: 



m (x) 



la v{x)dx 



, with u(x) = e -(*-o-78)V(o.i)- 
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Figure 4: Errors: E(m e > p ) (left), E(v e > p ) (right), p = 0...., 10 



We choose e = 0.2, as space discretization step p = 1.25 • 10 2 and as time step h = 0.02. 
Fig. [5] shows the mass evolution. As it is expected, during the evolution the mass 




Figure 5: Mass distribution mf 



distribution tends to concentrate at the "low energy" configuration x = 0.2 but at the 
same time the second term in F penalize this concentration. In Figj6] the discrete value 
function is shown and in Fig. [7] we display its gradient. 

In Fig. [8j we show the errors E(m £ ' p ) and E(v £ ' p ) of the fixed-point algorithm for the 
mass and the value function. The fixed-point iteration has been stopped when both the 
errors are below r = 10~ 3 . 

Let us finally compare this test to the case when there is no game, i.e. the running cost 
does not depend on m: 

F(x,m) = (x - 0.2) 2 . 

In this case, the system is not coupled and after one iteration we obtain the solution. 

In Fig. [9j the mass evolution is shown. It is seen that, during the evolution, the measure 
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Figure 6: Value function v\ 





maintains its original shape, due to the absence of conflict between the agents. This shows 
qualitative differences with the situation where conflict is present, as was displayed in the 
case of Fig. [5l 
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Figure 9: Mass distribution m\ k (case "no game" with F = (x — 0.2) 2 ) 
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